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Abstract. We study a nonlinear elliptic problem defined in a bounded do- 
main involving fractional powers of the Laplacian operator together with a 
concave-convex term. We characterize completely the range of parameters for 
which solutions of the problem exist and prove a multiplicity result. 



1. Introduction 

In the past decades the problem 

( -Am = f(u) in Slcl", 
1 u = on <9ft, 

has been widely investigated. See [3] for a survey, and for example the list (far 
from complete) [4, 12, 31] for more specific problems, where different nonlinearities 
and different classes of domains, bounded or not, are considered. Other different 
diffusion operators, like the p-Laplacian, fully nonlinear operators, etc, have been 
also treated, see for example [8, 15, 24] and the references there in. We deal here 
with a nonlocal version of the above problem, for a particular type of nonlinearities, 
i.e., we study a concave-convex problem involving the fractional Laplacian operator 

, , ( (-A)"/ 2 u = Xu^+uP, u>0 in ft, 

{ } { u = on dft, 

with < a < 2, 0<q<l<p< $±|, N > a, A > and ft C l w a smooth 
bounded domain. 

The nonlocal operator (—A) "/ 2 in is defined on the Schwartz class through 
the Fourier transform, 

[(-Ar/ 2 5 ] A (o = (27rieir?(o, 

or via the Riesz potential, see for example [28, 35] for the precise formula. As 
usual, g denotes the Fourier Transform of g, #(£) = J RN e~ 2 ~* lx '^g(x)dx. Observe 
that a = 2 corresponds to the standard local Laplacian. 

This type of diffusion operators arises in several areas such as physics, probability 
and finance, see for instance [6, 7, 20, 39]. In particular, the fractional Laplacian 
can be understood as the infinitesimal generator of a stable Levy process, [7]. 

There is another way of defining this operator. In fact, in the case a = 1 there is 
an explicit form of calculating the half-Laplacian acting on a function u in the whole 
space M. N , as the normal derivative on the boundary of its harmonic extension to 
the upper half-space R^ +1 , the so-called Dirichlet to Neumann operator. The "a 
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derivative" (— A) Q / 2 can be characterized in a similar way, denning the a-harmonic 
extension to the upper half-space, see [16] and Section 2 for details. This extension 
is commonly used in the recent literature since it allows to write nonlocal problems 
in a local way and this permits to use the variational techniques for these kind of 
problems. 

In the case of the operator defined in bounded domains f2, the above character- 
ization has to be adapted. The fractional powers of a linear positive operator in il 
are defined by means of the spectral decomposition. In [14], the authors consider 
the fractional operator (—A) 1 / 2 defined using the mentioned Dirichlet to Neumann 
operator, but restricted to the cylinder D, x M + C R+ +1 , and show that this defi- 
nition is coherent with the spectral one, see also [36] for the case a^l. We recall 
that this is not the unique possibility of defining a nonlocal operator related to the 
fractional Laplacian in a bounded domain. See for instance the definition of the so 
called regional fractional Laplacian in [9, 27], where the authors consider the Riesz 
integral restricted to the domain f2. This leads to a different operator related to a 
Neumann problem. 

As to the concave-convex nonlinearity, there is a huge amount of results involving 
different (local) operators, see for instance [1, 4, 8, 17, 19, 24]. We quoted the 
work [4] from where some ideas are used in the present paper. In most of the 
problems considered in those papers a critical exponent appears, which generically 
separates the range where compactness results can be applied or can not (in the 
fully nonlinear case the situation is slightly different, but still a critical exponent 
appears, [17]). In our case, the critical exponent with respect to the corresponding 
Sobolev embedding is given by 2* = This is a reason why problem (1.1) is 

studied in the subcritical case p < 2* — 1 = -^±2; see also the nonexistence result 
for supercritical nonlinearities in Corollary 4.6. 

The main results we prove characterize the existence of solutions of (1.1) in terms 
of the parameter A. A competition between the sublinear and superlinear terms 
plays a role, which leads to different results concerning existence and multiplicity 
of solutions, among others. 

Theorem 1.1. There exists A > such that for Problem (1.1) there holds: 

1. IfO < A < A there is a minimal solution. Moreover, the family of minimal 
solutions is increasing with respect to A. 

2. If X = A there is at least one solution. 

3. If X > A there is no solution. 

Moreover, we have the following multiplicity result: 
Theorem 1.2. For each < A < A, Problem (1.1) has at least two solutions. 

On the contrary, there is a unique solution with small norm. 

Theorem 1.3. For each < A < A fixed, there exists a constant A > such that 
there exists at most one solution u to Problem (1.1) verifying 

IMIoc < A. 

For a <G [1,2) and p subcritical, we also prove that there exists an universal 
i°°-bound for every solution independently of A. 
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Theorem 1.4. Let a > 1. Then there exists a constant C > such that, for any 
< A < A, every solution to Problem (1.1) satisfies 

\\u\\oo < C. 

The proof of this last result relies on the classical argument of rescaling in- 
troduced in [25] which yields to problems on unbounded domains, which require 
some Liouville-type results, which can be seen in [32]. This is the point where the 
restriction a > 1 appears. 

The paper is organized as follows: in Section 2 we recollect some properties of the 
fractional Laplacian in the whole space, and establish a trace inequality correspond- 
ing to this operator; the fractional Laplacian in a bounded domain is considered in 
Section 3, by means of the use of the a-harmonic extension; this includes studying 
an associated linear equation in the local version. The main section, Section 4, con- 
tains the results related to the nonlocal nonlinear problem (1.1), where we prove 
Theorems 1.1-1.4. 



2. The fractional Laplacian in 

2.1. Preliminaries. Let u be a regular function in R N . We say that w = E Q (w) 
is the a-harmonic extension of u to the upper half-space, R^ +1 , if w is a solution 
to the problem 



J -div(y 1 - a Vw) = inR^" 
\ w = u on R N x {y = 0}. 

In [16] it is proved that 

(2.1) ]imy- a ^{x,y) = -K a (-A) a / 2 u(x), 

y^o+ ay 

where n a = - — ' Observe that n a = 1 for a = 1 and n a ~ 1/(2 — a) as 
a — > 2 _ . As we pointed out in the Introduction, identity (2.1) allows to formulate 
nonlocal problems involving the fractional powers of the Laplacian in R N as local 
problems in divergence form in the half-space 

The appropriate functional spaces to work with are AT a (R^ +1 ) and H a / 2 (R N ), 

defined as the completion of C ( J (M^ +1 ) and Co°(R JV ), respectively, under the 
norms 

Ufxa - f iMV^s.y)! 2 dxdy, 

\^\ a \m\ 2 dt= I \(-Ar^( X )\ 2 dx. 

The extension operator is well defined for smooth functions through a Poisson 
kernel, whose explicit expression is given in [16]. It can also be defined in the space 
H a / 2 (R N ), and in fact 

(2-2) ||E a (V)l|x« =c a ||V||^/2, V*PeH a/2 (R N ), 
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where c a = y/K a , see Lemma 2.2. On the other hand, for a function <fi <G A a (R^ +1 ), 
we will denote its trace on R N x {y = 0} as Tr(0). This trace operator is also well 
defined and it satisfies 

(2-3) llTr^H^^c- 1 ^!!^. 

2.2. A trace inequality. In order to prove regularity of solutions to problem (1.1) 
we will use a trace immersion. As a first step we show that the corresponding result 
for the whole space holds. Although most of the results used in order to prove 
Theorem 2.1 below are known we have collected them for the readers convenience. 

First of all we prove inequality (2.3). The Sobolev embedding yields then, that 
the trace also belongs to L 2 ^(R N ), where 2* = j^z—- Even the best constant 
associated to this inclusion is attained and can be characterized. 

Theorem 2.1. For every z e A Q (R^ +1 ) it holds 

N-a 

(2.4) ( f \v(x)\^dx] " <S(a,N) [ y^lVztx, 
where v = Tr(z). The best constant takes the exact value 

(2.5) S(a,N) {2 > [ 2 >( [ >> 



| 2 dxdy, 



2 ^fr( 2 ^)r(^)(r(f))f 

and it is achieved when v takes the form 

(2.6) v(x) = (\x-x a \ 2 + T 2 y^, 
for some x € R N , t£R, and z = E a (v). 

The analogous results for the classical Laplace operator can be found in [22, 31]. 
The proof of Theorem 2.1 follows from a series of lemmas, that we prove next. 

Lemma 2.2. Let v e H a ^ 2 (R N ) and let z = E^(v) be its (3-harmonic extension, 
(3 e (a/2, 2). Then z G A Q (R^ +1 ) and moreover there exists a positive universal 
constant c(a, !3) such that 

(2.7) \\v\\ ka/2 =c{a,i3)\\A\x*. 
In particular if (3 = a we have c(a, a) = 

Inequality (2.4) needs only the case [3 = a, which was included in the proof of 
the local characterization of (—A)"/ 2 in [16]. The calculations performed in [16] 
can be extended to cover the range a/2 < (3 < 2 and in particular includes the case 
(3=1 proved in [40] . 

Proof. Since z = Efi(v), by definition z solves div(y 1_ ^Vz) = 0, which is equivalent 
to 

1-/3 dz d 2 z n 

A x z + - — + — = 0. 

V oy dy A 

Taking Fourier transform in x € for y > fixed, we have 

, 2ivi2 - 1 — dz d 2 z 

- 4 "'^ + — ^ + v= a 



A CONCAVE-CONVEX PROBLEM INVOLVING THE FRACTIONAL LAPLACIAN 



5 



andz(£,0) = Therefore z(£, y) = v(£)(t)p(2Tr\£\y), where <f>p solves the problem 



(2.8) 



+ 4>" = 0, 0(0) = 1, lim <t>(s) = 0. 



In fact, d>6 minimizes the functional 



(Msr + wistfy-Pds. 



and it can be shown that it is a combination of Bcssel functions, see [29]. More 
precisely, <fip satisfies the following asymptotic behaviour 



(2.9) 
where 



4>p (s) - 1 - CiS^ 



for s -> 0, 



C2S 2 e s , for s — » 00, 



i=£ 1/2 



2 1 ~*T(1 - ,8/2) 2^tt 
C UP) = flTVfl/0 x , c 2 (/9) = 



W/2) 



r(/3/2) 



Now we observe that 



9z 



Vzfoj/^da: =/ |V x z(ie, + — (x, y) 



dy 



dx 



95 

<9y 



Then, multiplying by y 1 Q and integrating in y, 



^R N 



^ 2 \e\m\ 2 (\M^\y)\ 2 + |^(27r|e|y)| 2 )y 1 -«^y 

= r(i^( a )i 2 +i^(«)iv- a d« / i^nnmi 2 ^. 

Jo Jr n 

Using (2.9) we see that the integral f^°(\<t>p\ 2 + \4>'p\ 2 )s 1 ~ a ds is convergent provided 
/3 > a/2. This proves (2.7) with c(a, 0) = {H^^))' 1 / 2 . □ 

Remark 2.1. If [3 = 1 we have 4>i{s) = e~ s , and H a (<j>{) = 2 a - 1 T(2 - a), 
see [40]. Moreover, when /3 = a, integrating by parts and using the equation 
in (2.8), and (2.9), we obtain 
(2.10) 

H a (K) = / [<Pl( S ) + (^) 2 (s)]s 1 - a rfs = - lW- a #,(«) - a Cl (a) = « a . 

Lemma 2.3. Let z e X Q (R^ +1 ) and Zet u> = E Q (Tr(z)) be its a-harmonic associ- 
ated function (the extension of the trace). Then 
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Proof. Observe that, for h = z — w, we have 

\\z\\ 2 xa = [ y 1 - a {\\7w\ 2 + \\7h\ 2 +2(Vw,Vh)). 

But, since Tr(/i) = 0, we have / y 1 ^ a (Ww,Wh) dxdy = 0. □ 

Lemma 2.4. If g e L~$k(R N ), and f e H a / 2 (R N ), then there exists a constant 
£(a, N) > such that 



(2.11) 



J f(x) g(x) dx < £(a, N)\\f\\ ka/2 \\g\\ ™_ 



Moreover, the equality in (2.11) with the best constant holds when f and g take the 
form (2.6). 

The proof follows and standard argument that can be found, for instance in [21, 
40]. 

Proof. By Parceval's identity and Cauchy-Schwarz's inequality, we have 
( f f(x)g(x)dx) = ([ f(0 9(0 dt) 

<([ \2^nT(o\ 2 cA ( f \2^\- a m)\ 2 dc). 

\Jm n J \Jm n J 

The second term can be written using [30] as 

/ \2^\-°\g(0?<% = b(*,N) f f x) °\?_ a dxdx', 

J R N J R 2N \X - X \" 

where 

r(£=s) 



b(a,N) = 



2 Q 7 r JV / 2 r(f ) ' 

We now use the following Hardy-Littlewood-Sobolev inequality, 

g(x)g(x') ^ J/ _ i Rn 2 



dxdx 1 < d(a,N)\\gf 2N 



N + a 



see again [30], where 

N — a. rt 

TT—T(a/2)(T(N))N 



d(a,N) = 



r((N + a)/2)(T(N/2))^ 

with equality if g takes the form (2.6). From this we obtain the desired esti- 
mate (2.11) with the constant £(a, N) = y/b(a,N)d(a,N). 

When applying Cauchy-Schwarz's inequality, we obtain an identity provided the 
functions |£| Q / 2 /(£) an d \£\~ a ^ 2 d(0 are proportional. This means 

9(0 = c\a\ a 7(o = c[(-a) q / 2 /] a (o. 

We end by observing that if g takes the form (2.6) and g = c(— A)"/ 2 / then / also 
takes the form (2.6). In fact, the only positive regular solutions to (— A) Q / 2 / = 
c/^ take the form (2.6), see [18]. □ 
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JV + Q i 

Proof of Theorem 2.1. We apply Lemma 2.4 with g = 1/1"-° /, then use 
Lemma 2.2 and conclude using Lemma 2.3. The best constant is S(a,N) — 
£ 2 {a,N)/ Ka . □ 

Remark 2.2. If we let a tend to 2, when N > 2, we recover the classical Sobolev 
inequality for a function in _ff 1 (R Ar ), with the same constant, see [38]. In order to 
pass to the limit in the right-hand side of (2.4), at least formally, we observe that 
(2 — a)y 1 ^ a dy is a measure on compact sets of R + converging (in the weak-* sense) 
to a Dirac delta. Hence 



lim / (f \Vz(x,y)\ 2 dx)(2-a)y 1 - a dy= [ \Vv 



(x)\ 2 dx. 



We then obtain 



JV-2 

([ \v(x)\^dx) " <S(N) f \Vv{x)\ 2 dx, 

N_ 

with the best constant S(N) — lim 5 f,"^ = lxN ^ N _ 2 ) (^ r^A72) ) ^ ■ ^ ^ s acm eved 
when v takes the form (2.6) with a replaced by 2. 

3. The fractional Laplacian in a bounded domain 

3.1. Spectral decomposition. To define the fractional Laplacian in a bounded 
domain we follow [14], see also [36]. To this aim we consider the cylinder 

C a = {{x,y):xeSl, yel+JcRf 1 , 
and denote by OlCq its lateral boundary. We also define the energy space 

X«(C n ) = {ze L 2 (C n ) : z = on d L C a , [ 2/ 1_Q |V 'z(x lV )\ 2 dxdy < c^}, 

JCn 

with norm 

\\z\\ 2 := / yi-o^zfrytfdxdy. 



We want to characterize the space O(fi), which is the image of Xq (Cq) under the 
trace operator, 

9(0) = {u = Tr(w) : w g X^(Cn)}. 
In particular we will show that the fractional Laplacian in a bounded domain f2 
is well defined for functions in 0(17). To this aim, let us start considering the 
extension operator and fractional Laplacian for smooth functions. 

Definition 3.1. Given a regular function u, we define its a-harmonic extension 
w = Eq(u) to the cylinder Cq as the solution to the problem 

' -div(y 1 - a Vw) = in C n , 

(3.1) I w = on d L C n , 

Tr(w) — u on VL. 

As in the whole space, there is also a Poisson formula for the extension operator in 
a bounded domain, defined through the Laplace transform and the heat semigroup 
generator e* A , see [36] for details. 
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Definition 3.2. The fractional operator (— A) Q / 2 in fl, acting on a regular function 
u, is defined by 

(3.2) (-A)"/ Vx) = -— lim y 1 -"^, y), 

where w — Ea( u ) an d K a is given as in (2.1). 

It is classical that the powers of a positive operator in a bounded domain are 
defined through the spectral decomposition using the powers of the eigenvalues of 
the original operator. We show next that in this case this is coherent with the 
Dirichlet-Neumann operator defined above. 

Lemma 3.3. Let (ipj,Xj) be the eigenf unctions and eigenvectors of —A in fi (with 
Dirichlet boundary data). Then (ifj,X^ 2 ) are the eigenfunctions and eigenvec- 
tors of (—A)"/ 2 in fl (with the same boundary conditions). Moreover, Ea(Vj) = 

1/2 

tpj(x)il)(\j y), where ij) solves the problem 

V>" + ^— ^ V' = V>, s>0, 
s 

— lim s 1_a V'( s ) = K a , 
V(0) = 1. 

The proof of this result, based on separating variables, is straightforward. The 
function \p coincides with the solution <p a in problem (2.8). 

Lemma 3.4. Let u e L 2 (S1). If u = J^ajipj, where ^ a|A"^ 2 < oo 7 then E a (u) G 
X£(C n ) and 

E a (u)(x,y) = ^a j ip j (x)ip(\y 2 y). 

Proof. The formula for the extension follows immediately from Lemma 3.3. 

Put w — E tt (ii). Using the orthogonality of the family {<fj}, together with 
J Q y> 2 = 1, J n \Vfj\ 2 = Xj, and (2.10), we have 



y^ a \Vw(x,y)\ 2 dxdy 

N + l 

+ 

OO 



/ 

Jm 

= I" > ^ 1 "YjEs 2 l V ^WI 2 V'(Ay 2 y) 2 + a^i^(^) 2 (V' / (A] / \)) 2 )^ 

POO 

fOO 



□ 



As in Section 2, we get that the extension operator minimizes the norm in 
Lemma 3.5. Let z e Xff(Cn) and let w = E Q (Tr(z)). Then 



\ z \\x°>(C n ) ~ \\ w txg(C a ) + II z ~ HI \g (Cn) ' 
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Lemmas 3.4 and 3.5 imply that the space 8(f2) coincides with the space 
equipped with the norm 

ii-n^(o) = (E a ? A " /2 ) 1/2 = ,l( - A)Q/4u|12 - 

Observe that Lemma 3.4 gives 

IMIi? ^ 2 (Q) = K « 1/2 H Ea( u )\\xg<Ca), 

which is the same as in (2.2) but for the spaces and norms involved. As a direct 
consequence we get that the fractional Laplacian is well defined in this space. 

Corollary 3.6. Let u £ H^ /2 {n), then (-A) q / 2 m = £%A" /2 <^. 

Let now v £ (Cq). Its extension by zero outside the cylinder Cq can be ap- 
proximated by functions with compact support in R+ +1 . Thus, the trace inequal- 
ity (2.4), together with Holder's inequality, gives a trace inequality for bounded 
domains. 

Corollary 3.7. For any 1 < r < -j^z^, and every z £ X^{Cq), it holds 
(3.3) ( f \v(x)\ r dx] ' <C(r,a,N,\Sl\) [ y 1 -^ z{x,y)\ 2 dxdy, 

\Jn / JCn 

where v = Tr(z). 

3.2. The linear problem. We now use the extension problem (3.1) and the ex- 
pression (3.2) to reformulate the nonlocal problems in a local way. Let g be a 
regular function and consider the following problems: the nonlocal problem 

f (-A)«/ 2 « = g(x) in n, 
[ ' \ u = on ffl, 

and the corresponding local one 



(3.5) 



- div(y 1 " a Vu;) = in C n , 

w = on d L Cn, 

1 .. t_„9w , . 

-— lim y 1 = g(x) on SZ. 



We want to define the concept of solution to (3.4), which is done in terms of the 
solution to problem (3.5). 

Definition 3.8. We say that w £ Xq (Cq) is an energy solution to problem (3.5), 
if for every function (p £ Cq(Cq) it holds 

(3.6) / ^<V«<.,,),V V (.,,))**-/« rf (,M,,0)*. 

JCn Jn 

In fact more general test functions can be used in the above formula, when- 
ever the integrals make sense. A supersolution (subsolution) is a function that 
verifies (3.6) with equality replaced by > (<) for every nonnegative test function. 
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Definition 3.9. We say that u € Hq (f2) is an energy solution to problem (3.4) 
if u = Tr(ui) and w is an energy solution to problem (3.5). 

In order to deal with problem (3.5) we will assume, without loss of generality, 
K a = 1, by changing the function g. 

In [13] this linear problem is also mentioned. There some results are obtained 
using the theory of degenerate elliptic equations developed in [23], in particular 
a regularity result for bounded solutions to this problem is obtained in [13]. We 
prove here that the solutions are in fact bounded if g satisfies a minimal integrability 
condition. 

Theorem 3.10. Let w be a solution to problem (3.5). If g <G L r (Q), r > ^, then 
weL°°{C n ). 



Proof. The proof follows the same ideas as in [26, Theorem 8.15] and uses the 
trace inequality (3.3). Without loss of generality we may assume w > 0, and this 
simplifies notation. The general case is obtained in a similar way. 

We define for (5 > 1 and K > k (k to be chosen later) a C 1 ([/c, oo)) function H, 
as follows: 

z^-M 3 , ze[k,K], 

linear, z > K. 



H{z) 



Let us also define v = w + k and choose as test function tp, 

<p = G(v)= f \H'(s)\ 2 ds, W(f=\H(v)\ 2 Wv. 

Replacing this test function into the definition of energy solution we obtain on one 
hand: 



L 



y l - a (\7w,\7ip)dxdy = [ y 1 ^ \ Vv\ 2 \H'(v)\ 2 dxdy 

JCn 

(3.7) = / V^lVHivtf dxdy 

N-a 

> (jjH(v)\^dx^ " =\\H(v)\\\^ 

where the last inequality follows by (3.3). 
On the other hand 

/ g(x)ip(x, 0) dx = / g(x)G(v)dx< I g(x)vG'(v)dx 
Jn Jn Jn 

\ f g(x)v 2 \H'(v)\ 2 dx=l f g(x)\vH'(v)\ 2 dx. 
k Jn fc Jn 



(3.8) 

< 

" k 

Inequality (3.7) together with (3.8), leads to 

(3.9) 11^)11^ < ^l\\g\\ r y 2 \\(vH\v)) 2 \\ 1 Jl = \\vH\v)\\^, 

by choosing k = \\g\\ r . Letting K — >• oo in the definition of H, the inequality (3.9) 
becomes 

||w|| 2Nf> < \\v\\ 2rfl . 
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Hence for all j3 > 1 the inclusion v G i 7:rT (ri) implies the stronger inclusion v G 
L™^(£1), since jfz^ > §zj provided r > — . The result follows now, as in [26], by 
an iteration argument, starting with j3 — ^Z^) > 1 anc ^ w e L 7rr »(fl). This gives 
u G L°°(Q), and then w € L°°(Cq)- In fact we get the estimate 

IMIoc < c(\\ w \\x" + \\g\\ r )- 

□ 

Corollary 3.11. Let w be a solution to problem (3.5). If g G L°°(f2), then w £ 
C 7 (Cfj) /or some 7 G (0, 1). 

Proof. It follows directly from Theorem 3.10 and [13, Lemma 4.4]. □ 



4. The nonlinear nonlocal problem 



4.1. The local realization. We deal now with the core of the paper; i.e. the 
study of the nonlocal problem (1.1). We write that problem in local version in the 
following way: a solution to problem (1.1) is a function u = Tr(w), the trace of w 
on £1 x {y = 0}, where w solves the local problem 



(4.1) 



■ div^^Vto) = in C n , 

w = on OlCq, 

= f(w) in fL 



where 

(4.2) P L {x) = - lim yi-°?E( x ,y). 

In order to simplify notation in what follows we will denote w for the function 
defined in the cylinder Cn as well as for its trace Tr(w) on il x {y = 0}. 

As we have said, we will focus on the particular nonlinearity 

(4.3) f( s ) = f x (s) = \s« + s p . 

However many auxiliary results will be proved for more general reactions / satis- 
fying the growth condition 

(4.4) < f(s) < c(l + |s| p ), for some p > 0. 

Remark 4.1. In the definition (4.2) we have neglected the constant n a appearing 
in (3.2) by a simple rescaling. Therefore, the results on the coefficient A for the 
local problem (4.1)-(4.3) in this section are translated into problem (1.1) with A 
multiplied by k^ 9 " 1 ^ 1 . 

Following Definition 3.8, we say that w G Xq(Cq) is an energy solution of (4.1) 
if the following identity holds 



/ y 1 a : (V 'w , V V) dxdy = / f(w)ipdx 
Jen 



12 



BRANDLE, COLORADO, AND DE PABLO 



for every regular test function ip. In the analogous way we define sub- and super- 
solution. 

We consider now the functional 

J{w) = l [ y^Vw] 2 dxdy - [ F(w)dx, 
2 Jen Jn 

where F(s) = J Q S /(r) dr. For simplicity of notation, we define f(s) = for s < 0. 
Recall that the trace satisfies w <G L r (£L), for every 1 < r < if N > a, 1 < r < 
oo if N < a. In particular if p < -j^rf, and / verifies (4.4) then F(w) € L 1 ^), and 
the functional is well defined and bounded from below. 

It is well known that critical points of J are solutions to (4.1) with a general 
reaction /. We consider also the minimization problem 

J = inf{ / y^Vwf dxdy : weX£(C n ), [ F(w)dx = l\, 
L JCn Jn ' 

for which, by classical variational techniques, one has that below the critical expo- 
nent, the infimum / is achieved. 

Proposition 4.1. If f satisfies (4.4) withp < ^z§, then there exists a nonnegative 
function w G Xq (Co) for which I is achieved. 

We now establish two preliminary results. The first one is a classical procedure 
of sub- and supersolutions to obtain a solution. We omit its proof. 

Lemma 4.2. Assume there exist a subsolution w\ and a super solution w 2 to 
problem (4.1) verifying W\ < w 2 . Then there also exists a solution w satisfying 
W\ < w < W2 in Cq. 

The second one is a comparison result for concave nonlincarities. The proof 
follows the lines of the corresponding one for the Laplacian performed in [10]. 

Lemma 4.3. Assume that f{t) is a function verifying that f{t)/t is decreasing for 
t > 0. Consider w\,W2 G Xq (Cq) positive subsolution, supersolution respectively to 
problem (4.1). Then ui\ < w 2 in Cq. 



f(wi)ip! dx, 



Proof. By definition we have, for the nonnegative test functions tpi and if2 to be 
chosen in an appropriate way, 

f y l - a (Vw u Vipx)dxdy < [ 
JCn Jn 

/ y 1_ "(Vw 2 , V(p 2 )dxdy > / f{w 2 )if2dx. 
Jc n Jn 

Now let 6{t) be a smooth nondccrcasing function such that 0(t) = for t < 0, 
0(t) = 1 for t > 1, and set e {t) = 9{t/e). If we put, in the above inequalities 

<Pi = w 2 E (w 1 - w 2 ), if 2 = wi s (wi - w 2 ), 

we get 

h> [ WlW2 (^-^)e s ( Wl - W2 )dx, 

Jn v w 2 wi J 
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where 



h ■= / y 1 a (wi Vid 2 - w 2 Vioi, V(toi - w 2 )) 0' s (wi - w 2 ) dxdy. 

JCn 



I Co. 

Now we estimate I\ as follows 



h < y 1 "(Vwi, (w 1 - w 2 )V(w 1 - w 2 )) 0' s (wi - w 2 ) dxdy 
= / y 1_a (Vwi, V7e(wi - w 2 )) dxdy 
where j' e (t) — t9' e (t). Therefore, since < -f e < e, we have 



h < / /(urb £ (wi - w 2 ) dx < ce. 



We end as in [4]. Letting e tend to zero, we obtain 



/ 



, ' f{w 2 ) fjwxY 
W1W2 dx < 0, 



nn{ Wl > W2 } \ w 2 wi 

which together with the hypothesis on / gives w\ < w 2 in f2. Comparison in Cq 
follows easily by the maximum principle. □ 

Now we show that the solutions to problem (4.1)-(4.4) are bounded and Holder 
continuous. Later on, in Section 4.4, we will obtain a uniform L°°-estimate in the 
case where / is given by (4.3) and the convex power is subcritical. 

Proposition 4.4. Let f satisfy (4.4) with p < ^-t" > and let w <G Xq(Cq) be an 
energy solution to problem (4.1). Then w e L°°(Cn) nC 7 (fi) for some < 7 < 1. 

Proof. The proof follows closely the technique of [11]. As in the proof of Theo- 
rem 3.10, we assume w > 0. We consider, formally, the test function y> = w^^ p 7 
for some (3 > p + 1. The justification of the following calculations can be made 
substituting ip by some approximated truncature. We therefore proceed with the 
formal analysis. We get, using the trace immersion, the inequality 

JV-Q 

f (/3- p +1)jv\ N fa 

/ w N - a <C(f3,a,N,n) / uA 

Jn ) Jn 

This estimate allows to obtain the following iterative process 

with = j^iPj + 1 - p). To have f3 j+1 > f3 3 we need ft- > (p ~ Q 1)JV . Since 
w e L 2 °(fi), starting with /3 = j^z^i w e get the above restriction provided p < 

— T-f no r> 1 o t- + Ti o +- in o fini + o f 

JV- 



— - It is clear that in a finite number of steps we get, for g(x) — f(w(x,0)), the 



regularity g G V for some r > ^. As a consequence, we obtain the conclusion 
applying Theorem 3.10 and Corollary 3.11. □ 
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4.2. A nonexistence result. 



Theorem 4.5. Assume f is a C 1 function with primitive F , and w is an energy 
solution to problem (4.1). Then the following Pohozaev-type identity holds 



1 



y 1 - a ({x,y),v)\Vw\ 2 do - N [ F(w)dx + ^—^ [ wf(w)dx = 0. 

Jn 2 J n 



'd L Cn 

Proof. Just use the identity 



((x,i/),i/)i/ a - 1 div(i/ 1 - a Vt«) +div [y x - a ({{x,y)yw) - ^(x, y)\Vw\ 2 ^j 
/N + 2-a \,„ l2 „ 

+( — g i)|vh 2 = o, 



where v is the (exterior) normal vector to dil. It is calculus matter to check this 
equality. □ 

Corollary 4.6. If O is starshaped and the nonlinearity f satisfies the inequality 
((N — a)sf(s) — 2NF(s)) > 0, then problem (4.1) has no solution. In particular, 
in the case f(s) = s p this means that there is no solution for any p > ^3^- 

The case a = 1 has been proved in [14]. The corresponding result for the 
Laplacian (problem (1.1) with a = 2) comes from [34]. 

4.3. Proof of Theorems 1.1-1.2. We prove here Theorems 1.1-1.2 in terms of 
the solution of the local version (4.1). For the sake of readability we split the proof 
of Theorem 1.1 into several lemmas. From now on we will denote 

' -div(y 1 " a Vw) = in C n , 

w = on 8 l Cq, 



(Px) 



dw 

- — = Xw q +w p , w > 



0, 



and consider the associated energy functional 

1 



y 



l-a 



Cn 



\Vw\ dxdy - I F\(w)dx, 
n 



where 



Fx(s) = 



A 



1 



q+1 p+l 
Lemma 4.7. let A be defined by 

A = sup{A > : Problem (P\) has solution}. 

Then A < oo . 



Proof. Consider the eigenvalue problem associated to the first eigenvalue Ai, and 
let ipi > be an associated eigenfunction, i.e., 

f -div(y 1 - a Vy>i) = in C n , 

<fii = on d L Cn, 

dipi 



in O. 
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Then using ipi as a test function in (Pa) we have that 

(4.5) / (Aw 9 + w p )(pi dx = Ai / wipi dx. 

Jn Jn 

There exist positive constants c, 5 such that Xt g + t p > c\ s t, for any t > 0. Since 
u > we obtain, using (4.5), that cX s < Xi which implies A < oo. □ 

This proves the third statement in Theorem 1.1. 

Lemma 4.8. Problem (Pa) has a positive solution for every < A < A. Moreover, 
the family {w\} of minimal solutions is increasing with respect to X. 

Remark 4.2. Although this A is not exactly the same as that of Theorem 1.1, see 
Remark 4.1, we have not changed the notation for the sake of simplicity. 



Proof. The associated functional to problem (P\) verifies, using Corollary 3.7, 

JxM = If y^Vwfdxdy- [ F x (w)dx 
z Jc a Jn 

o+l 

> \l y^l^wl 2 dxdy - XC\ ( I y^lVwl 2 dxdy 



Cn \JCn 

p+i 



-<L/ 



Vw\ dxdy 

Cn 

for some positive constants C\ and C<i- Then for A small enough there exist two 
solutions of problem (Pa), one given by minimization and another one given by the 
Mountain-Pass Theorem, [5] . The proof is standard, based on the geometry of the 
function g(t) = \i 1 — XC\t q+l — C2t p+1 , sec for instance [24] for more details. 

We now show that there exists a solution for every A G (0,A). By definition 
of A, we know that there exists a solution corresponding to any value of A close 
to A. Let us denote it by (i, and let be the associated solution. Now is a 
supersolution for all problems (Pa) with A < /i. Take v\ the unique solution to 
problem (4.1) with f(s) = Xs q . Obviously v\ is a subsolution to problem (P\). 
By Lemma 4.3 v\ < w^. Therefore by Lemma 4.2 we conclude that there is a 
solution for all A € (0, ji), and as a consequence, for the whole open interval (0, A). 
Moreover, this solution is the minimal one. The monotonicity follows directly from 
the comparison lemma. □ 

This proves the first statement in Theorem 1.1. 
Lemma 4.9. Problem (P\) has at least one solution if X = A. 



Proof. Let {A„} be a sequence such that A„ /• A. We denote by w n — w\ n the min- 
imal solution to problem (P\ n ). As in [4], we can prove that the linearized equation 
at the minimal solution has nonncgative eigenvalues. Then it follows, as in [4] again, 
J\ n (w n ) < 0. Since J'(w\) = 0, one easily gets the bound ||w„||x°(Cn) — ^- Hence, 
there exists a weakly convergent subsequence in XJ(Cjj) and as a consequence a 
weak solution of (Pa) for A = A. □ 

This proves the second statement in Theorem 1.1 and finishes the proof of this 
theorem. 
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Proof of Theorem 1.2. In order to find a second solution we follow some arguments 
in [4] . It is essential to have that the first solution is given as a local minimum of the 
associated functional, J\. To prove this last assertion we modify some arguments 
developed in [2]. 

Let Ao € (0, A) be fixed and consider Ao < Ai < A. Take 0o = w\ , <f>\ = 
the two minimal solutions to problem (P\) with A = A and A — Ai respectively, 
then by comparison, <f) < 4>i- We define 

M = {w€X«{C n ) : 0< W <<M. 

Notice that M is a convex closed set of Xq (Cq). Since J\ is bounded from bellow 
in M and it is semicontinuous on M, we get the existence of lo e M such that 
J\ {<±>.) = inftueM J\ ( w )- Let Vq be the unique positive solution to problem 



(4.6) 



div(j/ 1 - a Vu ) = in Co, 

v a = on d L Cn, 

dvo q . 

— — = va in it. 

dv a u 



Since for < e « A , and J\ (ev ) < 0, we have ev £ M, then w^O. Therefore 
■AoGiO < 0. By arguments similar to those in [37, Theorem 2.4], we obtain that w 
is a solution to problem (P\„)- There are two possibilities: 

• If lu ^ w\ i then the result follows. 

• If u = w\ a , we have just to prove that w is a local minimum of J\ . Then 
the conclusion follows by using an argument close to the one in [4], so we 
omit the complete details. 

We argue by contradiction. 

Suppose that uj is not a local minimum of J\ in Xq(Cq), then there exists a 
sequence {v n } C X$(Cq) such that \\v n - ul\\ x % -> and J\ (v n ) < J\ {oj). 

Let w n = (v n — 4>i) + and z„ = max{0, min{v„, <p\}}. It is clear that z n e M and 

tfv n (x,y)<0, 
v n (x,y) if < v n (x,y) < <f>i(x,y), 
<t>i(x,y) if<f>i(x,y)<v n (x,y). 

We set 



z n (x,y) = < 



T n = {(x,y) e Cn : z n (x,y) = v n (x,y)}, S n = supp(w„), 

T n = T n n ri, S n — S n n ri. 

Notice that supp(w+) = T n U S n . We claim that 
(4.7) \S n \n -> as n ->• oo, 

where = ^xj^di. 
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By the definition of F\, we set F\ (s) = — ^— H ^Ty s + +1 ' ^ or s e ^' anc ^ § ct 



■^AoK)=^ / V 1 a \\7v n \ 2 dxdy - [ F Xo (v n )dx 
Z JCn JO. 

=\ [ y^W z n \ 2 dxdy ~ [ Fx {z n )dx + \ f y^Vv^ 2 dxdy 

Z JT n JT n 1 J S n 



- f F Xo (v n )dx + l f y^lVv- 
=\ I z n \ 2 dxdy - [ F Xo (z n )dx 



dxdy 



+ o / y 1 a \^(w n + 4>i)\ 2 dxdy- F Xa {w n + 4> 1 )dx 

1 JS n JS n 

+ 11 y^Vv-fdxdy. 

Since 

/ y x - a \V z n \ 2 dxdy = f y 1 - a \Vv n \ 2 dxdy+ f y^V^ 2 dxdy 

JCn JT n JS n 



and 



/ F Xo {z n )dx = F Xo (v n )dx+ Fx {4>i)dx, 

JQ JT„ JS„ 



by using the fact that <f>\ is a supersolution to (Pa) with A = Ao, we conclude that 
J Xo (v n ) = Jx {zn) + \f y 1 - a (\W(w n + (b 1 )\ 2 -\\7cf, 1 \ 2 )dxdy 

- f {F XQ (w n + ^ 1 )-F Xa {4 )1 ))dx+ l - f y^Vv-] 2 dxdy 

> Jx {Zn) + \\\ W n\\\ S + \h-\\\ S 

- / {F Xo (w n +<f>i)- Fx {<j>i) - {Fx )u{<t>i)w n } dx 
Jn 



> Jxo& + l\\v n \fxg + l\K\\h 



- / {F Xo (w n + <Ai) - F Xo {(f>i) - {Fx )u{<t>i)w n } dx. 
Jn 

On one hand, taking into account that < q + 1 < 2, one obtains that 

< _J_ ( Wn + - - <j,\ Wn < 

The well known Picone's inequality (see [33]) establish: 

\Vu\ 2 -v(^j - \7v>0, 

for diffcrcntiable functions v > 0, u > 0. In our case, by an approximation argument 
we get 



r w 2 

Ao / -^dx<\\w n f xg . 
Jn 0! 
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On the other hand, since p + 1 > 2, 




— {w n + 4> 1 Y +1 - 1 



p + 1 

< c( P )(0r 1 ^+< +1 )- 

Hence using that p + 1 < 2* and the claim (4.7) 

4rK + m p+i ^r^ +1 - <** ^ 0(1)11^11^. 

p + 1 p+1 J 

As a consequence we obtain that 

Ja K) > Jx (^) + l\\w n \\ 2 xs (l-q-o(l)) + ^\\v-\\ 2 x . 

= Jxo(") + l\\w n f x *(l - q - 0(1)) + 0(1). 

Since q < 1, there results that J\ (ui) > J\ (v n ) > J\ (ui) for n > n , a contradic- 
tion with the main hypothesis. Hence a; is a minimum. 

To finish the proof we have to prove the claim (4.7). For e > small, and 5 > 
(6 to be chosen later), we consider 

E n = {x e f2 : v n (x) > 4>i(x) A 4>\{x) > w(x) + 5}, 
F n = {x e £1 : v n (x) > <fri{x) A 4>i{x) < w{x) + 6}. 

Using the fact that 



= \{x e fl : Mx) < u(x)}\ 



P| I x £ n : 4>i (x) < lo{x) + -\ 

3 = 1 3 > 



= lim < x € ft : <j>i(x) < w(x) H — 
we get for j a large enough, that if 8 < i then 

G SI : 0i(x) <w(x)+(5}| < |. 

Hence we conclude that |-F„|q < §. 

Since ||w„ — — > as n — > oo, in particular by the trace embedding, ||w„ — 

^IIl 2 (^) ~~ ^ 0- We obtain that, for n > n large, 

S 2 e 



> 



/ |w„ — co\ 2 dx > / |t)„ - uj] 2 dx > 5 2 \E n \n. 



Therefore \E n \a < Since S n <Z F n U E n we conclude that \S n \n < £ for n < ng. 



Hence |5 n |n — >• as n — » oo and the claim follows. 



□ 



4.4. Proof of Theorems 1.3-1.4 and further results. We start with the uni- 
form L°°-estimates for solutions to problem (1.1) in its local version given by (Pa)- 

Theorem 4.10. Assume a > 1, p < ]^+ a and N > 2. Then there exists a constant 
C = C(p,Cl) > such that every solution to problem (P\) satisfies 

IMloo < C, 
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for every < A < A. 

The proof is based in a rescaling method and the following two nonexistence 
results, proved in [32]: 

Theorem 4.11. Let a > 1. Then the problem in the half-space 
f - div<y- a Vw) = mR^ +1 
I = W p(x,0) ondR^ +1 =R N 

has no solution provided p < ^z§S if N >2, or for every p if N = 1. 
Theorem 4.12. The problem in the first quarter 

M^ 1 ={z = (x',x N ,y)\x' € l* -1 , x N > 0, y > 0}, 

' -div(y 1 - Q Vw) = 0, x N > 0, y > 0, 

— {x',x N ) = w p (x',x N ,0), 
V w(x',0,y) = 0, 
/ias no positive bounded solution provided p < jjr^ ■ 

Proof of Theorem 4.10. Assume by contradiction that there exists a sequence 
{w n } C Xq (Cfi) of solutions to (P\) verifying that M n = ||w„||oo — > oo, as n — > oo. 
By the Maximum Principle, the maximum of w n is attained at a point (x n , 0) where 
x n € £1. We define fi„ = ^(fi — x n ), with yu„ = Mn p ^ a i i.e., we center at x n 
and dilate by — > oo as n — > oo. 

We consider the scaled functions 

v n (x,y) = Wn ( Xn - '^'Vny) ^ for a; G fi„, y > 0. 

It is clear that ||u„|| < 1, v n (0, 0) = 1 and moreover 

divfe^Vvn) = in Cn n , 

«n = on d L Cn n , 

q£ = AM«< + < ^ O„x{0}. 

By the Arzela-Ascoli Theorem, there exists a subsequence, denoted again by v n , 
which converges to some function v as n — > oo. In order to see the problem satisfied 
by v we pass to the limit in the weak formulation of (4.8). We observe that ||w n ||oo < 
1 implies |KHx°<(c n ) < C- 

We define d n = dist (x n , dSY), then there are two possibilities as n — > oo according 
the behaviour of the ratio — : 

(1) 1 — 1 is not bounded. 
I J „ 

(2) < — — > remains bounded. 
I Mn J „ 



(4.8) 
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In the first case, since -Bd„/^„(0) C (l n , for another subsequence if necessary, it 
is clear that fi„ tends to R N and the limit function v is a solution to 

-div(y 1 - a Vu) = inK^ +1 , 
dv 



- — = v" on ^ , 

dv a + 

Moreover, v(0, 0) = 1 and v > which is a contradiction with Theorem 4.11. 

In the second case, we may assume, again for another subsequence if necessary, 
that — — > s > as n — > oo. As a consequence, passing to the limit, the domains 
0„ converge (up to a rotation) to some half-space H s = {x e R w : > — s}. We 
obtain here that v is a solution to 

-div(y 1 - Q Vu) = in H s x (0,oo), 

|l = v> onff s x{0}, 

with Halloo = 1, v(0, 0) = 1. In the case s = this is a contradiction with the 
continuity of v. If s > 0, the contradiction comes from Theorem 4.12. □ 

We next prove Theorem 1.3 in its local version. 

Theorem 4.13. There exists at most one solution to problem (P\) with small 
norm. 

We follow closely the arguments in [4], so we establish the following previous 
result: 

Lemma 4.14. Let z be the unique solution to -problem (4.6). There exists a constant 
(3 > such that 

(4-9) HWxsfr) - ? / * 9 ~V dx > PHfmn), ^ e X$(Cn). 

Proof. We recall that z can be obtained by minimization 

min{l||o;||^ (Cn) - -l_H|^ 1(n) : w G X «(C n )} . 
As a consequence, 

H^II^CCo) - q I z9 ~^ 2 dx ^ °' V< ^ e X ° ( C «)- 
This implies that the first eigenvalue p\ of the linearized problem 
- divfo 1 -"^) = 0, in C n , 

= 0, on d L Cn, 

^ - gz"- V = W>, on n x {0}, 

is nonnegative. 

Assume first that p\ = and let ^ be a corresponding cigenfunction. Taking 
into account that z is the solution to (4.6) we obtain that 



q / z q ipdx— / z q (fdx 
Jn Jn 
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which is a contradiction. 

Hence p\ > 0, which proves (4.9). □ 

Proof of Theorem 4.13. Consider A > such that pA^ 1 < f3, where f3 is given 
in (4.9). Now we prove that problem (P\) has at most one solution with L°°-norm 
less than A. 

Assume by contradiction that (P x ) has a second solution w = w\ + v veri- 
fying ||u>||oo < A. Since w\ is the minimal solution, it follows that v > in 
ft x [0,oo). We define now r\ = X^z, where z is the solution to (4.6). Then it 
verifies —div(y 1 ~ a \7i]) = 0, with boundary condition Xr] q . Moreover, w\ is a super- 
solution to the problem that r\ verifies. Then by comparison, Lemma 4.3, applied 
with f(t) = Xt g , v — r\ and w — w\, we get 

(4.10) w x > X^z on n x {0}. 

Since w — w\ + v is solution to (P\) we have, on ft x {0}, 

V) = + v) q + (wx + v)P < Xw\ + Xqw^v + (w x + v)P, 

where the inequality is a consequence of the concavity, hence 

< Xqw^v + (w x + v)P - w p x . 

Moreover, (4.10) implies w^ 1 < X~ 1 z q ~ 1 . From the previous two inequalities we 
get 

dv 

— < qz q - l v + [w X + v)P - w p x . 
Using that \\wx + w||oo < A, we obtain (wx +v) p — < pA p ~ 1 v. As a consequence, 

^ - qz^v < pAP-'v. 
Taking v as a test function and <p — v m (4-9) we arrive to 

f3 [ v 2 dx < pAP- 1 [ v 2 dx. 
Jn Jn 

Since pA p ~ x < (3 we conclude that v = 0, which gives the desired contradiction. □ 

Remark 4.3. This proof also provides the asymptotic behavior of wx near A = 0, 
namely wx ~ X~z, where z is the unique solution to problem (4.6). 
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1 Introduction 



In the past decades the problem 



-Au = f(u) in C 
u = on dO,, 



has been widely investigated. See [3] for a survey, and for example the list 
(far from complete) [U \12\ 135] for more specific problems, where different 
nonlinearities and different classes of domains, bounded or not, are consid- 
ered. Other different diffusion operators, like the p-Laplacian, fully nonlin- 
ear operators, etc, have been also treated, see for example [8j [151 EE] an d the 
references there in. We deal here with a nonlocal version of the above prob- 
lem, for a particular type of nonlinearities, i.e., we study a concave-convex 
problem involving the fractional Laplacian operator 

'-A) a ' 2 u = Xu q + u p , u>0 in ft, , , 

u = on 80, ^ ' ' 
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with 0< a < 2, 0<q<l<p< f^f , N > a, A > and Q C R w a smooth 
bounded domain. 

The nonlocal operator (— A) Q//2 in M N is defined on the Schwartz class 
of functions g £ S through the Fourier transform, 

[(-Ar/ 2 5 ] A (o = (2vrieir?(e), 

or via the Riesz potential, see for example [301 EZJ- Observe that a = 2 
corresponds to the standard local Laplacian. 

This type of diffusion operators arises in several areas such as physics, 
probability and finance, see for instance [6j [2T1 I41j . In particular, the 
fractional Laplacian can be understood as the infinitesimal generator of a 
stable Levy process, [7J. 

There is another way of defining this operator. In fact, in the case a = 1 
there is an explicit form of calculating the half-Laplacian acting on a function 
u in the whole space R , as the normal derivative on the boundary of its 
harmonic extension to the upper half-space the so-called Dirichlet 

to Neumann operator. The "a derivative" (— A) a / 2 can be characterized in 
a similar way, defining the a-harmonic extension to the upper half-space, 
see [T7] and Section [X] for details. This extension is commonly used in the 
recent literature since it allows to write nonlocal problems in a local way and 
this permits to use the variational techniques for these kind of problems. 

In the case of the operator defined in bounded domains f2, the above 
characterization has to be adapted. The fractional powers of a linear pos- 
itive operator in $7 are defined by means of the spectral decomposition. 
In [14j . the authors consider the fractional operator (—A) 1 / 2 defined using 
the mentioned Dirichlet to Neumann operator, but restricted to the cylinder 
0, x R_|_ c R+ +1 , and show that this definition is coherent with the spectral 
one, see also [38] for the case a / 1, We recall that this is not the unique 
possibility of defining a nonlocal operator related to the fractional Laplacian 
in a bounded domain. See for instance the definition of the so called regional 
fractional Laplacian in [25] , where the authors consider the Riesz integral 
restricted to the domain f2. This leads to a different operator related to a 
Neumann problem. 

As to the concave-convex nonlinearity, there is a huge amount of results 
involving different (local) operators, see for instance [H [U El [181 EH 125] . 
We quoted the work [1] from where some ideas are used in the present 
paper. In most of the problems considered in those papers a critical exponent 
appears, which generically separates the range where compactness results 
can be applied or can not (in the fully nonlinear case the situation is slightly 
different, but still a critical exponent appears, [18]). In our case, the critical 
exponent with respect to the corresponding Sobolev embedding is given by 
2q = N-a - This is a reason why problem (jl.ip is studied in the subcritical 
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case p < 2* — 1 = N _" i see a l so the nonexistence result for supercritical 
nonlinearities in Corollary 13.51 

The main results we prove characterize the existence of solutions of (jl.ip 
in terms of the parameter A. A competition between the sublinear and 
superlinear terms plays a role, which leads to different results concerning 
existence and multiplicity of solutions, among others. By a solution we 
mean an energy solution, see the precise definition in Section [3j 

Theorem 1.1 There exists A > such that for Problem (jl.ip there holds: 

1. If < A < A there is a minimal solution. Moreover, the family of 
minimal solutions is increasing with respect to A. 

2. If A = A there is at least one solution. 

3. If A > A there is no solution. 

4. For any < A < A there exist at least two solutions. 

For a £ [1,2) and p subcritical, we also prove that there exists a universal 
L°°-bound for every solution independently of A. 

Theorem 1.2 Let a > 1. Then there exists a constant C > such that, 
for any < A < A, every solution to Problem (jl.ip satisfies 

\\u\\oo < C. 

The proof of this last result relies on the classical argument of rescaling 
introduced in |27j which yields to problems on unbounded domains, which 
require some Liouville-type results, which can be seen in |34j . This is the 
point where the restriction a > 1 appears. 

The paper is organized as follows: we devote Section [2] to settle the 
preliminaries, such as define properly the fractional Laplacian in a bounded 
domain, by means of the use of the a-harmonic extension, and study an 
associated linear equation in the local version. The main section, Section [31 
contains the results related to the nonlocal nonlinear problem (jl.ip . where 
we prove Theorems Il.lf41.2t We include an appendix where some trace 
inequality, needed in the proofs, is obtained, with sharp constant. 

2 The fractional Laplacian in a bounded domain 

2.1 The a-harmonic extension 

To define the fractional Laplacian in a bounded domain we follow [14j . 
see also [38]. The idea is to use the a-harmonic extension introduced in [T7] 
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to define the same operator in the whole space, see also the Appendix, but 
restricted to our bounded domain. To this aim we consider the cylinder 

C n = {(x,y) :xeH, y G M+} C R^ +1 , 

and denote by 9lCq its lateral boundary. 

We first define the extension operator and fractional Laplacian for smooth 
functions. 



Definition 2.1 Given a regular function u, we define its a-harmonic ex- 
tension w = Ea(u) to the cylinder Cq as the solution to the problem 

- div(y 1 -°Vu;) = in C n , 

w = on 8 L C n , (2.1) 
w = u on Vl. 

As in the whole space, there is also a Poisson formula for the extension 
operator in a bounded domain, defined through the Laplace transform and 
the heat semigroup generator e* A , see [38] for details. 

Definition 2.2 The fractional operator (— A) Q//2 in £1, acting on a regular 
function u, is defined by 

(-A) a / 2 u(x) = -— lim y^-"^L(x,y), (2.2) 
K a y ^o+ ay 

where w = ~E a (u) and K a is given as in (|A. 1[) in the Appendix. 

This operator can be extended by density to a fractional Sobolev space. 



2.2 Spectral decomposition 

It is classical that the powers of a positive operator in a bounded domain 
(or in an unbounded domain provided the spectrum is discrete) are defined 
through the spectral decomposition using the powers of the eigenvalues of 
the original operator. We show next that in this case this is coherent with 
the Dirichlet-Neumann operator defined above. Let (<pj,\j) be the eigen- 
functions and eigenvectors of —A in f2 with Dirichlet boundary data. Define 
the space of functions defined in our domain 0, 

rt^u^o^a^) : ||n||^ /2 = (^a2Af 2 ) 1/2 <oo}, 
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its topological dual H a / 2 (f2), and also the energy space of functions defined 
in the cylinder Cq, 

X«(C n ) = {ze L\C n ) : z = on 8 L C n , \\z\\ 2 xs = (jf y^Vz^ ' < oo}. 

Lemma 2.3 1. The eigenf unctions and eigenvectors of (— A) a / 2 in f2 
u>ii/i Dirichlet boundary data are given by (ipj,\^ 2 ). 

2. Ifu = Y,aj*Pj e Hq /2 (Q) then E a (u) G A^(C n ) and 

E Q (n)(x,y) = ^a j (^ i (x)V'(A] /2 y), 
where ip(s) solves the problem 

s 

* — lim s a ip'(s) = K «) 

^(0) = 1. 

3. In the same hypotheses, (-A) a / 2 u G #~ Q / 2 (S1), and (-A) Q / 2 u = 

V- \a/2 

4. It hoZds 

||(-A)«/ 2 n||^ /2 = ||(-A)"/ 4 n|| L2 = ||n|| </2 = «-V»|| E a (u)\\ x «. 

The proof of this result is straightforward. The function ip coincides 
with the solution <p a in problem (|A.8j> . The calculation of the norms is also 
straightforward: Using the orthogonality of the family {<fj}, together with 
/ n if 2 = 1, f n |Vv?j| 2 = Xj, and (|A.10j) . we have 

/ y l - a \VV a {u)(x,y)\ 2 dxdy 

= f°°y l - a [ (^a 2 |V^(x)| 2 ^(A] /2 n) 2 + a 2 A J ^(x) 2 (^(A J 1/2 y)) 2 )a'xdn 
J J Q 

= r yl ~ a E a ^ (^ (A i /2 y)2 + wv^v)) 2 ) d y 

JO x 

= e 4 A f 2 r si ~ a {^) 2 + w) 2 ) * = *» e °k /2 

i/ 

= ^^(ajA" 74 ) 2 . 
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2.3 The linear problem 



We now use the extension problem (|2.ip and the expression 
reformulate the nonlocal problems in a local way. Let g be a regular 
and consider the following problems, the nonlocal problem 



{-A) a / 2 u = 
u = 

and the corresponding local one 

' - div(y 1-a Vu;) 

w 



< 



1 v i-a dw 
- — lim y 

Kay^0+ ay 



9(x) 









in Q, 
on <9Q, 



9(x) 



in Cn, 
on d L C n , 

on Q. 



to 

function 



(2.3) 



(2.4) 



We want to define the concept of solution to (|2.3p , which is done in terms 
of the solution to problem ([27 



Definition 2.4 We say i/iai w E Xq(Cq) is an energy solution to prob- 
lem (|2.4|) . i//or even/ function (p G Cq(Cq) it Zio/ds 

/ y -<V«(,,,),V v (,,,)>^./^(,M..O)-.. (2-5) 

In fact more general test functions can be used in the above formula, when- 
ever the integrals make sense. A supersolution (subsolution) is a function 
that verifies (|2.5p with equality replaced by > (<) for every nonnegative test 
function. 

Definition 2.5 We say that u G H^ 2 {Q) is an energy solution to prob- 
lem (|2.3p if it is the trace on Q, of a function w which is an energy solution 
to problem (|2.4p . 

It is clear that a solution exists for instance for every g 6 H~ a / 2 (tt). In 
order to deal with problem (|2.4p we will assume, without loss of generality, 
K a = 1, by changing the function g. 

In |13j this linear problem is also mentioned. There some results are 
obtained using the theory of degenerate elliptic equations developed in [23] , 
in particular a regularity result for bounded solutions to this problem is 
obtained in [13]. We prove here that the solutions are in fact bounded if g 
satisfies a minimal integrability condition. 

Theorem 2.6 Let w be a solution to problem (|2.4p . If g £ L r (£l), r > — , 
thenw G L°°(C n ). 
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Proof. The proof follows from the well-known Moser's iterative technique, 
that we take from [28j Theorem 8.15], and uses the trace inequality (|A.12|) . 
Without loss of generality we may assume w > 0, and this simplifies nota- 
tion. The general case is obtained in a similar way. 

We define for /? > 1 and K > k (k to be chosen later) a C 1 ([fc, oo)) 
function H, as follows: 

H (z) = l f - ^' Z ^^ K ^ 
\ linear, z > K. 

Let us also define v = w + k, v = Tr(v), and choose as test function <p, 

/•V 

tp = G(v)= I \H'(s)\ 2 ds, Vp = \H'{v)\ 2 Vv. 

Jk 

Observe that it is an admissible test function, though it is not C . Replacing 
this test function into the definition of energy solution we obtain on one 
hand: 



I y 1 - a (Vw,Vp)dxdy = I y^^Vv^H' {v)\ 2 dxdy 
JCq Jcq 

= [ y 1_Q |VF(t;)| 2 dxdy 

JCa 



N-a 

2 



> / \H(u)\Tf=s dx = \\H(v 



2N , 
N-a 



(2.6) 

where the last inequality follows by (|A.12|) . 
On the other hand 



g(x)ip(x,0) dx = / g(x)G{u) dx < / g(x)vG' (y) dx 

J ft J ft (2 7) 

<\t g{x)v 2 \H'{v)\ 2 dx = \ [ g(x)\uH\u)\ 2 dx. 
K JQ K J ft 



Inequality f|2.6j) together with (|2.7j) . leads to 

\\H(u)\\^_ < (\\\g\\X /2 \\{pH\v)) 2 t^l_ = \\vH'{v)\\^, (2.8) 

N-a yfc / r-1 r-1 

by choosing k = \\g\\ r . Letting K — >■ oo in the definition of H, the inequal- 
ity (|2.8p becomes 

Wl/W 2N0 < |M| 2r/3 . 
N — a r—1 

2r/3 

Hence for all (3 > 1 the inclusion v S L r ~ 1 ($7) implies the stronger inclusion 
v G L N -<* (Q), since > y3y provided r > ^. The result follows now, 
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as in [28] . by an iteration argument, starting with f3 = > 1 and 

v G Ln-<* This gives v G -L°°(rj), and then u; G L°°(Cq). In fact we get 
the estimate 

IMloo < c(||io||x« + Hffllr)- 

□ 



Corollary 2.7 Let w be a solution to problem (|2.4|) . If g £ L°°(0), £/ten 
u> G C 7 (Cn) /or some 7 G (0, 1). 

Proof. Using Theorem 12.61 the result follows directly from [131 Lemma 4.4], 
where it is proved that any bounded solution to problem (j2.4j) with a 
bounded g is C 7 . □ 



3 The nonlinear nonlocal problem 

3.1 The local realization 

We deal now with the core of the paper; i.e. the study of the nonlocal 
problem We write that problem in local version in the following way: 

a solution to problem (jl.ip is a function u = Tr(u>), the trace of w on 
ft x {y = 0}, where w solves the local problem 



div(y 1 - a V^) = in Cq, 

w = on diCn, 

f(w) in fl, 



(3.1) 



dv 



a 



where 



—— (x) = - lim — (3.2) 



Note. In order to simplify notation in what follows we will denote, when 
no confusio arises, w for the function defined in the cylinder Cq as well as 
for its trace Tr(w) on x {y = 0}. 

As we have said, we will focus on the particular nonlinearity 

f(s) = fx(s) = \si + S p. (3.3) 

However many auxiliary results will be proved for more general reactions / 
satisfying the growth condition 

< f(s) < c(l + \s\ p ), for some p>0. (3.4) 
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Remark 3.1 In the definition (|3.2[) we have neglected the constant K a ap- 
pearing in (|2.2p by a simple rescaling. Therefore, the results on the coeffi- 
cient A for the local problem (|3.ip - (|3.3p in this section are translated into 
problem (jl.ip with A multiplied by k^ 9 ^ 1 . 

Following Definition [231 we say that w G Xq{Cq) is an energy solution 
of (|3.1|) if the following identity holds 

/ y 1 ~ a (Vw,'S7(p) dxdy = / f(w)ipdx 
Jc n Jn 

for every regular test function </>. In the analogous way we define sub- and 
supersolution. 

We consider now the functional 

J(w) = ~ [ y 1-a |Vu;| 2 dxdy - [ F{w)dx, 
2 Jc n Jn 

where F(s) = f(r) dr. For simplicity of notation, we define f(s) = 
for s < 0. Recall that the trace satisfies w G (again this means 

Tr(w) G L r (n)), for every 1 < r < if N > a, 1 < r < oo if N < a. 

In particular if p < and / verifies fj3.4[) then F(w) G and the 

functional is well defined and bounded from below. 

It is well known that critical points of J are solutions to (|3.ip with a 
general reaction /. We consider also the minimization problem 

/ = inf{ f y^Vu-l 2 dxdy : w G Xq(Cq), [ F(w)dx = l\, 

for which, by classical variational techniques, one has that below the critical 
exponent the infimum / is achieved. This gives a nonnegative solution. Later 
on we will see that this infimum is positive provided A > is small enough. 
On the contrary, for A large enough the infimum is the trivial solution. 

We now establish two preliminary results. The first one is a classical 
procedure of sub- and supersolutions to obtain a solution. We omit its 
proof. 

Lemma 3.1 Assume there exist a subsolution w\ and a supersolution u>2 
to problem (|3.ip verifying w\ < w<i- Then there also exists a solution w 
satisfying w\ < w < W2 in Cq. 

The second one is a comparison result for concave nonlinearities. The 
proof follows the lines of the corresponding one for the Laplacian performed 
in [EH- 
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Lemma 3.2 Assume the function f(t)/t is decreasing for t > and con- 
sider 101,102 £ Xq(Cci) positive subsolution and super solution, respectively, 
to problem (|3.ip , T/ien ioi < 102 in Cq. 



Proof. By definition we have, for the nonnegative test functions (p\ and <p2 
to be chosen in an appropriate way, 

y^ a (Vwi, Vipi) dxdy < \ f(w 1 )(p 1 dx, 
c n Jn 



y a (Vw 2 ,Vtp 2 )dxdy> / f(w 2 )tp2dx. 
c n Jn 

Now let 6(t) be a smooth nondecreasing function such that 9{t) = for 
t < 0, 6(t) = 1 for t > 1, and set e (i) = 0(f). If we put, in the above 
inequalities 

ip 1 =w 2 E (w 1 -W2), ip 2 = ioi O e (wi - io 2 ), 

we get 

h > / ^1^2 )6 £ {wi - w 2 )dx, 

Jn K w 2 ioi / 

where 

:= / V102 — 102 V101, V(ioi — 102)) 0' £ (wi — w 2 ) dxdy. 

JCn 

Now we estimate 1\ as follows: 



h < y 1 a (Vwi, (101 - io 2 )V(ioi - io 2 )) 0g(ioi - W2) dxdy 



l-OLl 

V 

Cn 

y 1 ^ a (Vwi,V'j e (wi -w 2 ))dxdy 

'Cn 

where 7g(t) = t9' £ {t). Therefore, since < j e < e, we have 



h< f{wi)le{w\ ~ w 2 ) dx < ce. 
Jn 

We end as in [3]. Letting e tend to zero, we obtain 



/ 10l10 2 

JSin{«ii>to 2 } 



V 10 2 Wl I 



which together with the hypothesis on / gives 101 < 102 in O. Comparison 
in Cq follows easily by the maximum principle. □ 

Now we show that the solutions to problem (|3.ip - (|3.4p are bounded 
and Holder continuous. Later on, in Section 13. 4^ we will obtain a uniform 
L°°-estimate in the case where / is given by (|3.3p and the convex power is 
subcritical. 
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Proposition 3.3 Let f satisfy (j3.4|) withp < ^r§, and let w G Xq (CpJ &e 
an energy solution to problem (|3.ip . T/ien u; G L°°(Cn) nC 7 (Cn) /or some 
< 7 < 1. 



Proof. The proof follows closely the technique of [TT]. As in the proof of 
Theorem 12.61 we assume w > 0. We consider, formally, the test function 
= w^~ p , for some /3 > p + 1. The justification of the following calculations 
can be made substituting <p by some approximated truncature. We therefore 
proceed with the formal analysis. We get, using the trace immersion, the 
inequality 

N-a 

w f-« <C(J3,a,N,n) w p . 

n J Jn 

This estimate allows us to obtain the following iterative process 



Ml/3 i+a < c\\w\\2 p+ \ 



with (3j + i = + 1 — p). To have /3 J+ i > f3j we need f3j > {EzlMl , 

Since w G L 2 "(J7), starting with /3q = ™ , we get the above restriction 
provided p < ffij^ . It is clear that in a finite number of steps we get, for 
g(x) = f(w(x,0)), the regularity g G L r for some r > ^. As a consequence, 
we obtain the conclusion applying Theorem 12.61 and Corollary 12.71 □ 

3.2 A nonexistence result 

The following result relies on a the use of a classical Pohozaev type 
multiplier. 

Proposition 3.4 Assume f is a C 1 function with primitive F, and w is an 
energy solution to problem (|3.ip . Then the following Pohozaev-type identity 
holds 

I [ y 1 - a ((x,y),u)\Vw\ 2 da - N [ F(w) dx + - ~ - f wf(w)dx = 0. 
* Jd L Cn Jn % Jn 

Proof. Just use the identity 

((x,y),i/)y Q! - 1 div(y 1 - Q! V«;)+div [j/ 1 - tt (((i I j|) l Vifl) - \{x, y)\Vw\ 2 ~) 



N + 2-a 



where v is the (exterior) normal vector to d£l. It is calculus matter to check 
this equality. □ 
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As a consequence we obtain a nonexistence result in the supercritical 
case for domains with particular geometry. 

Theorem 3.5 If Q is starshaped and the nonlinearity f satisfies the in- 
equality ((N — a)sf(s) — 2NF(s)) > 0, then problem ()3.ip has no solution. 
In particular, in the case f(s) = s p this means that there is no solution for 
anyp> fff. 

The case a = 1 has been proved in [TJ]. The corresponding result for 
the Laplacian (problem (jl.ip with a = 2) comes from [36 1. 



3.3 Proof of Theorem fTTTI 



We prove here Theorem 11.11 in terms of the solution of the local ver- 
sion (|3.ip . For the sake of readability we split the proof of into several 
lemmas. From now on we will denote 



(A 



div(y 1 - a Vw) = 0, 



w 
dw 



0, 



Xw q + w p , u>0 



in C n , 
on d L Cn, 

in Q, 



and consider the associated energy functional 

1 

2 



y a \\7w\ dxdy — I F\{w)dx, 



Cn 



where 



X 



1 



?+l p+l 
Lemma 3.6 Let A be defined by 

A = sup{A > : Problem (P\) has solution}. 
Then < A < oo. 



Proof. Consider the eigenvalue problem associated to the first eigenvalue 
Ai, and let if\ > be an associated eigenfunction, see Lemma 12.31 Then 
using ipi as a test function in (P\) we have that 

/ (Xw 9 + w p )(fi dx = Ai / wipi dx. (3-5) 
Jn Jn 

Since there exist positive constants c, 5 such that Xt q + t p > cX s t, for any 
t > we obtain from (|3.5p (recall that u > 0) that cX s < X\ which implies 
A < oo. 
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To prove A > we use the sub- and supersolution technique to construct 
a solution for any small A. In fact a subsolution is obtained as w = £<p\, 
e > small. A supersolution is a suitable multiple of the function e solution 
to 





div(y 



l-a 



Ve) 

e 

de 




1 



in C n , 
on d L Cn, 

in $7. 



□ 



This proves the third statement in Theorem 11.1 



Lemma 3.7 Problem (P\) has a positive solution for every < A < A. 
Moreover, the family {w\} of minimal solutions is increasing with respect 
to A. 



Remark 3.2 Although this A is not exactly the same as that of Theo- 
rem (TTTJ see Remark 13.11 we have not changed the notation for the sake of 
simplicity. 



Proof. We already proved in the previous lemma that Problem (P\) has 
a solution for every A > small. Another way of proving this result is to 
look at the associated functional J\. Using Theorem IA. 51 we have that this 
functional verifies 



J\(w) = - f y^ a \Vw\ 2 dxdy - [ F x (w) dx 
>Cn Jn 



2 



3+1 



> 1 I y l ~ a \Vw\ 2 dxdy - ACj I y l - a \Vw\ 2 dxdy^ J 
2 JCn V/Cn 

-C 2 ( [ y l - a \Vw\ 2 dxdy)^ , 

for some positive constants C\ and Ci. Then for A small enough there exist 
two solutions of problem (P\), one given by minimization and another one 
given by the Mountain-Pass Theorem, [S]. The proof is standard, based 
on the geometry of the function g(t) = ^t 2 — XC\t q+1 — C2t p+1 , see for 
instance [2S] for more details. 

We now show that there exists a solution for every A £ (0,A). By 
definition of A, we know that there exists a solution corresponding to any 
value of A close to A. Let us denote it by /i, and let be the associated 
solution. Now is a supersolution for all problems (P\) with A < [i. Take 
v\ the unique solution to problem (|3.1|) with f(s) = Xs q . Obviously v\ 
is a subsolution to problem (-Pa)- By Lemma T3.2I v\ < w^. Therefore by 
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Lemma 13.11 we conclude that there is a solution for all A G (0,/x), and as 
a consequence, for the whole open interval (0, A). Moreover, this solution 
is the minimal one. The monotonicity follows directly from the comparison 
lemma. □ 

This proves the first statement in Theorem II .11 
Lemma 3.8 Problem (P\) has at least one solution if X = A. 

Proof. Let {A n } be a sequence such that A n /* A. We denote by w n = w\ n 
the minimal solution to problem (P\ n ). As in [3], we can prove that the 
linearized equation at the minimal solution has nonnegative eigenvalues. 
Then it follows, as in [I] again, J\ n {w n ) < 0. Since J'(w\) = 0, one easily 
gets the bound ||wn||xg l (C , n) — ^ - Hence, there exists a weakly convergent 
subsequence in Xff (Cq) and as a consequence a weak solution of (P\) for 
A = A. □ 

This proves the second statement in Theorem 1 1. 11 To conclude the proof 
of that theorem, we show next the existence of a second solution for every 
< A < A. It is essential to have that the first solution is given as a local 
minimum of the associated functional, J\. To prove this last assertion we 
follow some ideas developed in [2]. 

Let Ao G (0>A) be fixed and consider Ao < Xi < A. Take 4>q = w\ , 
4>i = w Xi t ne t wo minimal solutions to problem (P\) with A = Ao and 
A = Ai respectively, then by comparison, <p$ < We define 

M = {w G X£(C n ) : < w < fa}. 

Notice that M is a convex closed set of Xq(Cq). Since J\ is bounded from 
bellow in M and it is semicontinuous on M, we get the existence of to G M 
such that J\ (uj) = mi w€ M J\ (w). Let vq be the unique positive solution 
to problem 



div(y 



l-a 



Vv ) 


= o, 


in 


Cn, 




= o, 


on 


d L C n , 


dv 


- v q 

— w 0' 


in 


n. 


dv a 







(3.6) 



(The existence and uniqueness of this solution is clear). Since for < e << 
Ao, and J\ (evo) < 0, we have evo G M, then w^0. Therefore Ja (^) < 0- 
By arguments similar to those in [39, Theorem 2.4], we obtain that a; is a 
solution to problem (P\ ). There are two possibilities: 

• If u_ ^ ui\ , then the result follows. 
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• If u = w\ , we have just to prove that lj is a local minimum of J\ . 
Assuming that this is true, the conclusion in part 4 of Theorem 11.11 
follows by using a classical argument: The second solution is given by 
the Mountain Pass Theorem, see for instance [5]. 

We prove now that the minimal solution w\ is in fact a local minimum 
of J\ . We argue by contradiction. 

Suppose that to is not a local minimum of J Xo in X^Cq), then there 
exists a sequence {v n } C Xq (Cq) such that \\v n — u\\x§ and J\ (v n ) < 

Let w n = (v n — 4>i) + and z n = max{0, min{t; n , <^>i}}. It is clear that z n € M 
and 

if v n (x,y) < 0, 

z n (x,y) = < v n (x,y) if < v n (x, y) < ^(x, y), 
k &i(x,y) if ^>i(x,y) < v n (x,y). 

We set 

T n = {(x, y) £ Cq : z n (x, y) = v n (x, y)}, S n = supp(w n ), 

T n = T n n f2, S n = S n n f2. 

Notice that supp(v+) = T n U S n . We claim that 

\S n \a — > as n — > oo, (3-7) 

where |^4|q = J^XA^cfe. 

By the definition of F\, we set F\,,(s) = — - — H s?" 1 , for s € M, 

and get 

J h( v n) =2 / y 1_a |Vf n | 2 drcdy - / F X() (v n ) dx 



^ / y l ~ a \Vz n \ 2 dxdy- f F Xo (z n )dx + ^ f y^Vv^ 2 dxdy 

J T n J T n J Sn 

- L F Xo (v n )dx + - I y^Vv^l 2 dxdy 

\ I y 1 ^^ z ™\ 2 dxd y ~ ~ F x ( z n)dx 

+ - I y l - a \V{w n + 0i)| 2 dxdy - f F Xo {w n + fa) 

/■ 

Co 



y l - a \Vv-\ 2 dxdy. 



15 



Since 



I y l ~ a \V z n \ 2 dxdy = I y l - a \Vv n \ 2 dxdy+ I y 1 '^^ 2 dxdy 
J On JT n J S n 

and 

/ F Xo {z n )dx = I F Xo (v n )dx + F Xo ((pi)dx, 

by using the fact that 0i is a supersolution to (P\) with I = Iq, we conclude 
that 

J k) (Vn) = Jl a (Zn) + \( ^(IVK + cAl)! 2 -{V^dxdy 



2 



S n 

' ' l-air7..-|2 



(F A() ( Wn + 0x) - F Xo (0 X )) dx + i / // 1 - ! j V / ! 2 d.rdii 



> Jl () ( z n) + ^ ll^nllxg" + 2 H W ra 



- / { f A (Wn + 01 ) - ^A o (0l) - (-pA o )«(0l)^n} dx 
> Jl (u) + ^\\Wn\\xg + glbn 

- / {F Ao (w„ + 0i ) - Fa o (0i) - (F Ao ) u (0i)w„} dx. 

On one hand, taking into account that < g + 1 < 2, one obtains that 

o < — L(™ n + ^i)^ 1 - — 0? + 1 - 0>„ < ^4^-- 

-g+l v ^ ; q + l 1 1 2 0}-9 

The well known Picone's inequality (see [35]) establish: 

\Vu\ 2 - V f— ^ • > 0, 



for differentiable functions v > 0, u > 0. In our case, by an approximation 
argument we get 



7 f W n i ^ n . . 2 

Jn X * 



On the other hand, since p + 1 > 2, 

p+ i p + 



< rK + 0l) P+1 -— -0? +1 -0>n<^K + 0l) p - 1 



Hence using that p + 1 < 2* and the claim ([3 



+ 0l) P+1 " ^T0? +1 " 0>n )• < °(1)IKIIV 

p + 1 + 1 I 
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As a consequence we obtain that 

JfoK) > ^o(^) + ^ll U; nllx-( 1 -9- ( 1 )) + ^lbnllx« 

= JiM) + gKllxfCi - ? - o(i)) + o(i). 

Since g < 1, there results that Ji (id) > Ji (v n ) > Jl (w) for n > no, a 
contradiction with the main hypothesis. Hence u is a minimum. 

To finish the proof we have to prove the claim (|3.7|) , For e > small, 
and <5 > (5 to be chosen later), we consider 

E n = S O : u n (x) > 0i(x) A 0i(x) > + 5}, 
F n = {x G : u n (s) > 0i (a:) A 0i(x) < a;(x) + 6}. 



Using the fact that 

= \{x G : 0i (x) < w(x)}| 



P| |x G : 0i (x) < w(x) + y j 



lim 



x G U : 0i (x) < w(x) H — 

J 



we get for jo large enough, that if d < then 



|{x G fl : 0i (x) < u(x) + 5}\ < -. 

Hence we conclude that \F n \n < §. 

Since \\v n — w||x« — >■ as n — > oo, in particular by the trace embedding, 
ll^n — ^llL 2 (r2) ~~ > 0- We obtain that, for n > no large, 

5 2 e 



> 



uj\ 2 dx > 



w| 2 <ix > (5 2 |i? n |o- 



Therefore |-E n |n < Since 5 n C F n U i£ n we conclude that |5 n |n < e for 



n < no- Hence |S. 



7i n 



as n — )• oo and the claim follows. 



□ 



3.4 Proof of Theorem 11.21 and further results 

We start with the uniform L°°-estimates for solutions to problem (jl.ip 
in its local version given by (P\). 

Theorem 3.9 Assume a > 1, p < and N > 2. Then there exists a 

constant C = C(p, £1) > suc/i i/iai every solution to problem (P\) satisfies 

\\M\oo < C, 

for every < A < A. 
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The proof is based in a rescaling method and the following two nonexis- 
tence results, proved in [34J: 



Theorem 3.10 Let a > 1. Then the problem in the half-space 



div(y 1 °Vw 
dw 







in 



pAT+l 



(x) = w p (x,0) on 



pJV+l 



has no solution provided p < ]^t° , if N > 2, or for every p if N = 1. 

Theorem 3.11 The problem in the first quarter 

= {z = (x',x N ,y) | x' e R N - 1 , x N > 0, y > 0}, 



f - div(y 1_a V«;) = 0, 
div 

(x',x N ) = w p (x',x N ,0), 



x N > 0, y > 0, 



w(y,0,y) 



0, 



/ias no positive bounded solution provided p < . 



Proof of Theorem 13.91 Assume by contradiction that there exists a sequence 
{w n } C Xq (Cn) of solutions to (Pa) verifying that M n = ||w n ||oo — > co, as 
n —> oo. By the Maximum Principle, which holds for our problem, see |24j . 
the maximum of w n is attained at a point (x n , 0) where x n 6 fi. We define 
O n = — x„), with [i n = Mn p ^°, i.e., we center at x n and dilate by 

— > oo as n — > oo. 



We consider the scaled functions 



v n (x,y) 



w n {x n + fj, n x,fi n y) 



for x 6 f2 n , y > 0. 



It is clear that ||t>n|| < 1, v n (0, 0) = 1 and moreover 

■divd/^Vu,,) = in C n „, 

v n = on d L Cn n , 

- p in Q„ x {0}. 



<9tv. 



(3.8) 



By Arzela-Ascoli Theorem (the solution is C 7 , see Proposition 13. 3p . there 
exists a subsequence, which we denote again by v n , which converges to some 
function v as n — > oo. In order to see the problem satisfied by v we pass 
to the limit in the weak formulation of (13.81) . We observe that llfrilloo 

< 1 



implies ||?; n | 



< c. 



We define d n = dist(x n , dfl), then there are two possibilities as n — > oo 



according the behaviour of the ratio 



d„ . 
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— 1 is not bounded. 
. J n 

2. I — \ remains bounded. 



In the first case, since B^/^iO) C Q n , and Q n is smooth, it is clear that 
0„ tends to and v is a solution to 



( div(y 1 - Q V?;) = in 

°" " on dR* +1 . 



< 



Moreover, v(0, 0) = 1 and v > which is a contradiction with Theorem 13. 101 

In the second case, we may assume that — — ^ s > as n - > oo. As a 
consequence, passing to the limit, the domains f2 n converge (up to a rotation) 
to some half-space H s = {x € R-^ : xn > —s}- We obtain here that v is a 
solution to 

■ div(y 1-a Vv) = in H s x (0,oo), 

dv 



v'P on H s x {0}, 



with || v || oo = 1, v(0, 0) = 1. In the case s = this is a contradiction with 
the continuity of v. If s > 0, the contradiction comes from Theorem 13. Ill □ 

We next prove a uniqueness result for solutions with small norm. 

Theorem 3.12 There exists at most one solution to problem (P\) with 
small norm. 

We follow closely the arguments in [1] , so we establish the following previous 
result: 

Lemma 3.13 Let z be the unique solution to problem (j3.6|) . There exists a 
constant (3 > such that 

Ufx^Ca) - q J n zq ~ l(f>2dx ~ WHiw e X£(C n ). (3.9) 

Proof. We recall that z can be obtained by minimization 

min {^IMIx ( ?(c„) - ^j\\ w \\ L + q li { n) ■ w G Xo(Cn] 
As a consequence, 
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This implies that the first eigenvalue a\ of the linearized problem 

- div(y 1 - Q V<A) = 0, in C n , 

4> = 0, on d L Cn, 

is nonnegative. 

Assume first that a\ = and let ^ be a corresponding eigenfunction. 
Taking into account that z is the solution to (|3.6|) we obtain that 



g / z g ipdx= / z g ipdx 



which is a contradiction. 

Hence a\ > 0, which proves (|3.9p . □ 

Proof of Theorem 13.121 Consider v4 > such that pA p ^ 1 < (3, where /3 is 
given in (|3.9p . Now we prove that problem has at most one solution 
with L°°-norm less than A. 

Assume by contradiction that (P\) has a second solution w = w\ + v 

verifying ||iu||oo < A. Since w\ is the minimal solution, it follows that v > 

i 

in x [0, oo). We define now x] = X 1 -iz, where z is the solution to (|3.6|) . 

Then it verifies — I- (y 1 ~ a X7r]) = 0, with boundary condition Xr] q . Moreover, 

w\ is a supersolution to the problem that r/ verifies. Then by comparison, 

Lemma [3T2| applied with f(t) = Xt q , v = rj and w = w\, we get 

w\ > X^z on Q x {0}. (3.10) 
Since w = w\ + v is solution to (P\) we have, on £2 x {0}, 

d{W g u t V) = H™x + v) q + (w x + u)f < Xw q x + A^" 1 ^ + K + ^) P , 



where the inequality is a consequence of the concavity, hence 
^ < Xqw^v + (w A + v) p - w p x . 



Moreover. ()3.10j) implies m? X >A 1 z 9 1 . From the previous two inequalities 
we get 

■p- < qz q - l v + {wx + v) p - w{. 

Using that \\w\ + «||oo < A we obtain (w\ + u) p — < pA p ~ 1 v. As a 
consequence, 

g^" 1 ?; < pA p - l v. 



dv a 
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Taking v as a test function and <j> = v in (j3.9|) we arrive to 

{3 [ v 2 dx< pAP' 1 [ v 2 dx. 
Jn Jn 

Since pA p ~ l < (3 we conclude that t? = 0, which gives the desired contradic- 
tion. □ 



Remark 3.3 This proof also provides the asymptotic behavior of w\ near 

i 

A = 0, namely w\ « X^-iz, where z is the unique solution to problem (|3.6p . 



A Appendix: A trace inequality 

A.l Preliminaries. The problem in the whole space 

Here we recall the definition of the fractional Laplacian in the whole 
space and its local representation by means of the extension to one more 
variable, as it is done in [T7] . 

Let u be a regular function in WL N . We say that w = E a {u) is its en- 
harmonic extension to the upper half-space, if w is a solution to the 
problem 

J - div(y 1 - Q Vw) = inM^ +1 , 

\ w = u on R N x {y = 0}. 

In [17] it is proved that 

hm = - Kq (-A)"/ 2 u(x), (A.l) 

2 1 - Q r(l-a/2) 

where K a = r( ; /2) ■ 

The appropriate functional spaces to work with are and 

H a / 2 (R N ), defined as the completion of C£°(M^ +1 ) and C^(R N ), respec- 
tively, under the norms 



2 / „ 1-a 

x a - 



JV+l 



y^Wfay)] 2 dxdy, 



2 

jja/2 



\2*Z\ a \fa)\ 2 dt= / \(-Ar/^(x)\ 2 dx. 
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The extension operator is well denned for smooth functions through a 
Poisson kernel, whose explicit expression is given in [T7|. It can also be 
defined in the space H a / 2 (R N ), and in fact 

|| EaWIU* =Ca\MH<*/2, y^eH a ^ 2 (R N ), (A.2) 

where c a = \/~K a , see Lemma IA.21 On the other hand, for a function 
4> G X Q (IR+ +1 ), we will denote its trace on R N x {y = 0} as Tr(0). This 
trace operator is also well defined and it satisfies 

||Tr(0)|U Q/2 ^c^WWx*- (A.3) 



A.2 The trace immersion 

From (|A.3p . the Sobolev embedding yields then that the trace also be- 
longs to L 2 <x(M. N ), where 2* = ^ . Even the best constant associated to 
this inclusion is attained and can be characterized. Although most of the 
results used in order to prove the following theorem are known, we have 
collected them for the readers convenience. 

Theorem A.l For every z G A" a (R+ +1 ) it holds 

N-ot 

\v(x)\"=^dx) <S(a,N) y l ~ a \Vz{x,y)\ 2 dxdy, (A.4) 



N+l 
+ 



where v = Tr(z). The best constant takes the exact value 



r(f)r(^)(r(AQ)t 
27 rfr(^)r(^)(r(f))f 



' 2— a ^jy N-l-i; w - 1 - j .V 

and it is achieved when v takes the form 



v(x) = r^~(|x -x Q \ 2 + t 2 ) 2 , (A.6) 



for some xq G M. N , r > 0, and z = E a (v). 

The analogous results for the classical Laplace operator can be found 



m 

Lemma A.2 Let v G H a ^ 2 (M, N ) and let z = ~Ep(v) be its (3 -harmonic ex- 
tension, (3 G (a/2,2). Then z G A AQ (R^ +1 ) and moreover there exists a 
positive universal constant c(a, (5) such that 

\\v\\fjc/2 = c(pt, f$)\\z\\x* ■ (A. 7) 

In particular if (3 = a we have c(a,a) = 1/J~R^. 
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Inequality ()A.4j) needs only the case /3 = a, which is deduced directly from 
the proof of the local characterization of (—A)"/ 2 in [T7J. The calculations 
performed in [T7] can be extended to cover the range a/2 < (3 < 2 and in 
particular includes the case (3 = 1 proved in [42]. 

Proof. Since z = Es(u), by definition z solves div(y 1_ ^Vz) = 0, which is 
equivalent to 

1-/3 dz d 2 z 

A x z + H - — + — = 0. 

y ay oy z 

Taking Fourier transform in x £ M. N for y > fixed, we have 

. 9,>.i9* 1 — 13 dz d 2 z 

-4tt 2 ^ 2 z+ ^ — + — = 0. 

y oy oy A 

and z(£, 0) = Therefore z(£,y) = w(£)(^g(27r|£|y), where ^ solves the 

problem 



■ + 



+ 0" = 0, <£(0) = 1, lim = 0. 



(A.8) 



In fact, 0a minimizes the functional 



(i^ + i^iv-^. 



and it can be shown that it is a combination of Bessel functions, see [31 
More precisely, (ftp satisfies the following asymptotic behaviour 

(s) ~ 1 — c\sP, for s — > 0, 



where 



s) ~ C2S 2 e 



2 i-/3r(i - 1) 



(A.9) 



for s — > oo, 



, c 2 (/3) 



Now we observe that 
\Vz(x, y)\ 2 dx 



riV/ 2 
r(|) ' 



Va;z(x,y)| + -z-{x,y) 



dy 



dx 



Then, multiplying by y 1 "" and integrating in y, 
y l - a \Vz(x,y)\ 2 dxdy 



o Jm n 



JR N 

oo 



^ 2 \z\ 2 \m\ 2 {\M^\z\y)\ 2 + l^^ieis/)! V~ Q <» 



(i^( a )i 2 +i^( a )iv _a ^ / \2*t\ a \m\ 2 <%- 
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Using (|A.9j) we see that the integral J °° (\4>i3\ 2 + l^| 2 ) sl 01 ds is convergent 
provided (3 > a/2. This proves (TO) with c(a,(3) = (iJ a (0 /3 ))" 1/2 . □ 

Remark A.l If = 1 we have 0x(s) = e~ s , and fT a (0i) = 2 a-1 r(2 - a), 
see [32]. Moreover, when /3 = a, integrating by parts and using the equation 
in (|A.8|) . and (|A.9j) . we obtain 

/>oo 

^a(^) = / [4>l(s) + (^) 2 (»)]s 1_a ds = - lim s^VJs) = «c x (a) = K a . 
Jo s ^ 

(A.10) 

Lemma A. 3 Let z G X a (M^ +1 ) and Ze£ io = E Q (Tr(z)) 6e its a-harmonic 
associated function (the extension of the trace). Then 

II II 2 _ || 1 1 2 | II ||2 

ll^llx a — I ^ILy" ~t~ 11^ — ^llx a * 



Proof. Observe that, for h = z — uu, we have 

|Le||ia = / y l ~ a (\Vw\ 2 + \Vh\ 2 + 2(Vw,Vh)). 

But, since Tr(/i) = 0, we have / y l ' a (Vw : V/i) dxdy = 0. □ 



Lemma A. 4 If g G L^+«(R iV ), and / G H a / 2 (R N ), then there exists a 
constant £(a, N) > snc/i i/iat 



f(x)g(x)dx 



<Z{ot,N)\\f\\ ka/2 \\g\\^. (A.ll) 

N+ct 



Moreover, the equality in (|A.11|) with the best constant holds when f and g 
take the form (|A.6j) . 

The proof follows by an standard argument that can be found, for in- 
stance in 



Proof. By PargevaPs identity and Cauchy-Schwarz's inequality, we have 
f(x)g(x)dx] = ( f f(0m<% 



<([ \2nt\ a \f(£)\ 2 <%) ( [ \2ntr a \g(0\ 2 dt) . 
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The second term can be written using |32j as 

/ \2*Z\- a \m\ 2 dt = K°,N) f i ^nN ^ dxdx 'i 

Jrn j R 2n \x - x'yi a 

where 

b(a,N) 1 2 ' 



2«vr w / 2 r(f ) ' 

We now use the following Hardy-Littlewood-Sobolev inequality, see again [32] , 

g(x)g(x') , 2 
-j^dxdx < d{a,N)\\g\\ 2N 



\x — x \" " JV+^ 
where 

7 r^r(f)(r(iv))f 

d(a,N) = — — — — , 

r{ N±a m N ))w 

with equality if g takes the form ()A.6jl . From this we obtain the desired 
estimate (jA.lip with the constant £(a, N) = ^/b(a, N)d(a, N). 

When applying Cauchy-Schwarz's inequality, we obtain an identity pro- 
vided the functions \£\ a l 2 f{£) and \£,\~ a ^ 2 g((,) are proportional. This means 

?(o = cier/(o = c[(-Ar/ 2 /] A (e). 

We end by observing that if g takes the form (|A.6p and g = c(—A) a / 2 f then 
/ also takes the form (|A.6j) . □ 

Proof of Theorem \A.l\ We apply Lemma lA.41 with g = \ f\ N ~ a f, then use 
Lemma [A. 2 1 and conclude using Lemma fA.31 The best constant is S(a, N) = 
£ 2 (a,N)/ Ka . a 

Related to this result we quote the work [19] , where it is proved that the 

, N+a 

only positive regular solutions to (— A) a > f = cf N ~ a take the form (|A.6p , 

Remark A. 2 If we let a tend to 2, when A > 2, we recover the classi- 
cal Sobolev inequality for a function in i7 1 (M Ar ), with the same constant, 
see [ID] . In order to pass to the limit in the right-hand side of (|A.4j) , at least 
formally, we observe that (2 — a)y l ~ a dy is a measure on compact sets of 
M+. converging (in the weak-* sense) to a Dirac delta. Hence 

lim / (f \Vz(x,y)\ 2 dx] (2-a)y 1 ~ a dy= f \Vv(x)\ 2 dx. 
a ^ 2 ~ Jo \Jr n J Jr n 

We then obtain 

JV-2 

rnvr \ AT f 

|2 



v(x)\^dx) <S{N) \Vv(x)\ z dx 
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with the best constant S(N) = lim "^-o^ = nN(N-2) \ I ^ • ^ * s 
achieved when t> takes the form ()A.6j) with a replaced by 2. 

Let now v G Xq(Cq). Its extension by zero outside the cylinder Cq 

can be approximated by functions with compact support in Thus, 
the trace inequality (|A.4|) . together with Holder's inequality, gives a trace 
inequality for bounded domains. 

Theorem A. 5 For any 1 < r < 3_ , and every z E Xq(Cq), it holds 

(^J \v(x)\ r dx^j ' <C(r,a,N,\n\) J y 1 ~ Q |V«(a;, y)\ 2 dxdy, (A.12) 
where v = Tr(2;). 
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